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By using an extended mean-field theory we study the phase diagram ol the topological Kondo lat- 
tice model on the honeycomb lattice at half-filling, in which the conduction electrons are described 
by the Haldane model. Besides the well-defined Kondo insulator and normal antiferromagnetic spin- 
density-wave (N-SDW) state, it is found that a novel and nontrivial topological antiferromagnetic 
SDW state (T-SDW) with a quantized Hall conductance is possible if the quasiparticle gap is dom- 
inated by the next-nearest neighbor hopping rather than the antiferromagnetic order. By analyzing 
the low-energy effective Chern-Simon action and the corresponding chiral edge-state, the T-SDW 
could be considered as a quantum anomalous Hall insulator with antiferromagnetic long-range order. 
This novel state is apparently beyond Landau- Ginzburg paradigm, which can be attributed to the 
interplay of quantum anomalous Hall effect and the subtle antiferromagnetic order in the Kondo 
lattice-like model. While the transition between the SDW states and the Kondo insulator is found 
to be conventional (a first order transition), the transition between the N- and T-SDWs is, however, 
a topological quantum phase transition. Interestingly, such topological quantum phase transition 
can be described by Dirac fermions coupled to a U(l) Chern-Simon gauge-field, which resembles the 
critical theory between bosonic integer quantum Hall phases and superfluid phase and also indicates 
such topological quantum phase transition may fall into the 3D-XY universal class. It is expected 
that the present work may shed light on the interplay between conduction electrons and the densely 
localized spins on the honeycomb lattice. 



I. INTRODUCTION 

Understanding the emergent novel quantum phases 
and corresponding quantum criticality in heavy fermion 
compounds is still a challenge in modern condensed mat- 
ter physicsji - — To capture the essential physics in these 
phenomena, the Kondo lattice model is introduced to 
describe the interplay between the Kondo screening and 
the magnetic interaction, namely, the Ruderman-Kittel- 
Kasuya-Yosida (RKKY) exchange interaction, which 
is mediated by conduction electrons among localized 
spins While the former favors a nonmagnetic spin sin- 
glet state in strong coupling limit, the latter one tends 
to stabilize usual magnetic ordered states in weak cou- 
pling limit. There seems to exist a quantum phase tran- 
sition or even a coexistence regime between these two 
kinds of well-defined states^ - — however, a more rad- 
ical critical quantum phase perhaps has been observed 
in the compound of YW^^o.gsGeo.os^r 1 ^ which fur- 
ther motivates people to study more rich phases beyond 
those mentioned above. 

In recent years much progress in fact has been made 
in exploring the novel quantum phases j^Zr— which is 
obviously beyond the conventional Landau- Ginzburg 
paradigm, where the states of matter are classified based 
on the conventional symmetry-breaking picture. For ex- 
ample, the so-called topological spin-wave-density (T- 
SDW) state found by He et al£2- in the extended Hub- 
bard model can not distinguish from the normal SDW 
(N-SDW) state according to the broken-symmetry and 



the corresponding local order parameters introduced, in- 
stead He et al. used the quantized Hall conductance or 
the topological matrices K. to identify these novel topo- 
logical states^ The success in identifying novel phases 
by using the quantized Hall conductance motivates us to 
further explore whether such a novel phase exists or not 
in other strongly correlated models. 

In this work we consider a modified Kondo lattice 
model, where conduction electrons are described by the 
Haldane model on the honeycomb lattice at half-filling. 
According to Ref. [38j], this model can be called "topo- 
logical Kondo lattice". We use the extended mean-field 
decoupling^ to explore its phase diagram. Besides the 
well-defined Kondo insulator and the N-SDW phase, a 
nontrivial T-SDW phase with quantum anomalous Hall 
effect is possible if the quasiparticle gap is dominated 
by the next-nearest neighbor hopping rather than the 
antiferromagnetic order. Furthermore, such novel state 
can be fully encoded by its low energy effective Chern- 
Simon action, which underlies the nontrivial quantized 
Hall response to the external electromagnetic field. Then, 
by examining the stability of the gapless chiral edge- 
state derived from the Chern-Simon action, the T-SDW 
state could be considered as an example of the quantum 
anomalous Hall insulator with antiferromagnetic long- 
ranged order. 

Moreover, the transition between the mentioned SDW 
states and the Kondo insulator is found to be conven- 
tional first order transition in the sense of the Landau- 
Ginzburg broken-symmetry picture. However, the tran- 



2 



sition between the T- and N-SDWs is a topological quan- 
tum phase transition. Interestingly, such topological 
quantum phase transition can be described by two-flavor 
Dirac fermions coupled to a U(l) Chern-Simon gauge- 
field, which resembles the critical theory between bosonic 
integer quantum Hall phases and superfluid phase in Ref. 
[49l | and indicates the critical behaviors should fall into 
the 3D-XY universal class. In our view, the similarity 
between our case and the bosonic integer quantum Hall 
transition is indeed an interesting new finding and it is 
desirable to see more examples where some ferminic the- 
ories can dual to certain kinds of bosonic ones. 

Additionally, to our knowledge, since no realistic ma- 
terials could be modeled by the proposed topological 
Kondo lattice model, we have to expect such model and 
the novel T-SDW state may be realized in experiments 
of ultra-cold atoms on the honeycomb optical lattices in 
near future. The present work has an attempt to uncover 
novel quantum states beyond the conventional Landau- 
Ginzburg paradigm for the Kondo lattice-like models 
on the honeycomb lattice, thus sheds light on the rich 
physics involved in the heavy fermion systems. The fine 
but more sophisticated numerical approaches can be used 
for further study on the system. 

The remainder of this paper is organized as follows. 
In Sec. UH we first introduce the topological Kondo lat- 
tice model on the honeycomb lattice and provide a brief 
discussion on the Haldane model and its quantized Hall 
conductivity. Then Sec. IIIII is devoted to the mean- field 
treatment of the topological Kondo lattice. Three dis- 
tinct states are found and one of them is identified as the 
T-SDW state, which shows the quantum anomalous Hall 
effect in spite of the established antiferromagnetic long- 
ranged order. In Sec. [IV] the global ground-state phase 
diagram is proposed based on the mean-field decoupling 
and the corresponding quantum phase transitions are 
also discussed. In Sec. |V] the critical theory for the 
topological quantum phase transition is studied and we 
find that its critical behaviors should fall into the usual 
3D-XY universal class though the critical theory is for- 
mulated by Dirac fermions coupled to U(l) Chern-Simon 
gauge-field. The Kane-Mele-Kondo lattice model 3 ^, the 
extended Bernevig-Hughes-Zhang model?! and the spin 
fluctuation effect in SDW states beyond the mean-field 
treatment of Sec. IIIII are also briefly discussed in this 
section. Finally, Sec. I VII is devoted to a brief conclusion. 



II. THE TOPOLOGICAL KONDO LATTICE 
MODEL 

The model we considered is the anisotropic Kondo lat- 
tice model, where the conduction electrons are described 
by the spinful Haldane model on the honeycomb lattice 



at half-filling, 
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where Hjj is the spinful Haldane model, 53 which sup- 
ports the quantum anomalous Hall (QAH) effect with 
two chiral edge states (one for spin-up and the other for 
spin-down), t and t' are the nearest-neighbor and the 
next-nearest-neighbor hopping, respectively^ The phase 
iflij = ±-^7T is introduced to give rise to a quantum Hall ef- 
fect without external magnetic fields (the so-called QAH) 
and the positive phase is gained with anticlockwise hop- 
ping. Besides, the pseudofermion representation for lo- 
cal spins has been utilized as S" = \ J2aa> d \cr T a<j' d i<^' 
with r a being usual Pauli matrix and a local constraint 
d\^di-\ + d\^dii = 1 enforced in each site. H\\ denotes the 
magnetic instability due to the polarization of conduc- 
tion electrons by local spins while H± describes the local 
Kondo screening effect resulting from spin-flip scattering 
process of conduction electrons by local moments. 

The interplay of the mentioned Kondo screening and 
the magnetic instability on the honeycomb lattice with- 
out the nontrivial next-nearest-neighbor hopping term 
(t') has been studied by the present authors in the pre- 
vious worki^i There either a direct first-order transition 
or a possible coexistence of the Kondo insulator and the 
N-SDW state was obtained by the extended mean-field 
decoupling. 

Here, we would like to see whether a novel quantum 
state could be found in the topological Kondo lattice 
(Eq. [T]). This is motivated by the recent work in the 
so-called topological Hubbard model, where the usual 
Haldane model is complemented with the Hubbard on- 
site repulsion interaction U.— In such a model, the T- 
SDW states with nontrivial edge excitations were discov- 
ered and classified by the effective Chern-Simon theory 
with different JC matrices. Most importantly, all of these 
T-SDW states have the same physical symmetries with 
antiferromagnetic long-range order. Thus, in the sense 
of Landau-Ginzburg paradigm they are the same states. 
However, these states have different edge states and Hall 
conductance from the N-SDW states, which display that 
the T-SDW states are indeed distinguished with their 
normal counterparts, namely, the N-SDW states. 

It should be emphasized that the T-SDW states should 
not be identified as symmetry-protected-topological 
(SPT) state o 42 ! 43 since breaking the symmetry of the con- 
servation of total electron number (this symmetry pro- 
tects the edge-state) will lead to superconducting states 
rather than a usual antiferromagnetic phase. By original 
definition in Ref.JHj], the SPT states should smoothly 
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evolve into their corresponding conventional state, e.g. 
the topological insulator evolves into usual band insulator 
when breaking the time-reversal symmetry] 29 ' 30 There- 
fore, based on the above definition, we will not consider 
the T-SDW states as certain kinds of SPT phases. Mean- 
while, it also cannot be considered as the Chern insulator 
because as a Chern insulator, it should both exhibit a 
nonzero Hall conductance and preserve the lattice trans- 
lational symmetry^ while the T-SDW states double the 
effective lattice constant, which obviously breaks original 
lattice translational symmetry, due to the antiferromag- 
netic long-range order. 

Before moving to the discussion of the topological 
Kondo lattice model in the next section, it is helpful to 
give a brief argument on the low energy effective theory of 
Haldane model and its corresponding Chern-Simon treat- 
ment since these issues may not appear in literature of 
heavy fermions and the same technique will be used in 
the next section. 



A. The massive Dirac fermions from Haldane 
model 

In this subsection, we will derive an effective action 
of the Haldane model, which can be described by free 
massive Dirac fermions in 2+1D. 

Our starting point is the spinful Haldane model^ 3 - 

E H = -t £ cU. - H X e^cU>. (2) 

(ij)" <<U')> cr 

It is useful to rewrite this single-particle Hamiltonian in 
the momentum space as 

ka 

+2t' 1 {k)[c{ A<y c kA< y - c\ Ba c kBa \, (3) 

where we have defined f(k) = e~ lk * + 2e lk */ 2 cos(^/c a ), 

-y(fc) = sm(V3ky) — 2 cos(|fca;) sm(^-ky) and A, B repre- 
senting two nonequivalent sublattices of the honeycomb 
lattice, respectively. Then, by diagonalizing the above 
Hamiltonian, one obtains the quasiparticle energy band 
as 

E ka ± = ±^t 2 \f{k)\ 2 +At' 2 1 {k) 2 , (4) 

which preserves the particle-hole symmetry and also the 
spin degeneracy. It is well-known that for 3V3V < t, 
the excitation gap mainly opens near six Dirac points 
(Only two of them are nonequivalent in fact)^ Then, 
expanding both f(k) and "f(k) near two nonequivalent 
Dirac points ±K = ±(0, ^j), respectively, the gap can 
be found as A gap — 6y/3t' and the quasiparticle energy 
reads E qa± ~ ±yj(%tq) 2 + (SV^f) 2 with q = {q x ,q v ) = 
(k x ,k y T g*7j). 



It is easy to check that both the quasiparticle energy 
E q(T ± and the excitation gap A gap can be reproduced by 
the following effective massive Dirac action 

Sh = d 2 xdrC Q = / d 2 xdr ^[tpaail^d^ + m)i/w], 

where 7^ = {t z ,t x ,t v ) and <9 M = (d T ,d x ,d y ) with 
T z ,T Xl T y the usual Pauli matrices. Here we introduce 
the effective mass m = —3y3t' of Dirac fermions and 
set the effective Fermi velocity vf = %t to unit. The 
Dirac fields are defined as 4>ia = (ciAa, c\Ba) T : i>2cr = 
(c 2 Acr, -c 2 Ba) T and tp aa - = V'Lto with a = 1,2 denot- 
ing the states near the two nonequivalent Dirac points 
±K = ±(0, and T implying the transposition ma- 
nipulation. 

B. The Chern-Simon action for the massive Dirac 
fermions in 2+1D 

Having obtained the effective massive Dirac action in 
2+1D, it is interesting to see its physical response to the 
external electromagnetic field A p = (i<p,A x ,A y ) with <f> 
and A = (A x , A y ) representing the usual scalar and vec- 
tor potential, respectively. The electromagnetic field can 
be readily introduced into the Dirac action by the con- 
ventional minimal coupling, namely, — > — ieA^. 
Thus, the resulting effective Dirac action coupled with 
the external electromagnetic field reads 

S = d 2 xdr^^ypaail^dn - ieA^) + m)ip aa ]. (5) 

acr 

By integrating out the Dirac fields, we get an effec- 
tive Chern-Simon action, which represents the electro- 
magnetic response of the massive Dirac fermions to the 
external electromagnetic field ^^(For details, see Ap- 
pendix A.) 

S CS = [ d 2 xdr[Ne 2 ^-e^ x A^A x ], (6) 
J 8n\m\ 

where N = 4 (two from spins and the other two from 
the nonequivalent Dirac points), is the usual all- 

antisymmetric tensor and we have dropped out the regu- 
lar Maxwell term (~ F 2 ^) since the low energy physics is 
dominated by the Chern-Simon term alone. We should 
emphasize that although the effective Chern-Simon ac- 
tion is used here, it does not imply any fractionalization 
or nontrivial topological order (A characteristic signature 
of the topological order is the ground-state degeneracy 
depending on the topology of the system.) because no 
emergent gauge fields or fractionalized quasiparticles ex- 
ist in the present case^i 

Now, one can see that the quantized Hall conductance 

°H = ¥ ^ J x = fel^O = Ne2 W^ Ao ~ 
doAy) — =§-E v where h = 2ttH is reintroduced and we 
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have also used m/\m\ = — 1 and N = 4. 24 Since the quan- 
tized Hall conductance is realized without any external 
magnetic field (A — > 0), the Haldane model (or its low 
energy theory) just provides an example of the quantum 
anomalous Hall effect, which is defined as a band insula- 
tor with quantized Hall conductance but without orbital 
magnetic field ^ 



III. MEAN-FIELD TREATMENT OF 
TOPOLOGICAL KONDO LATTICE 

In this section, we will use mean-field decoupling to 
study the ground-state phase diagram of the topological 
Kondo lattice model (Eq. pQ ) . Fluctuation effect beyond 
the present mean-field treatment will be analyzed in Sec. 

m 

By utilizing the mean-field decoupling introduced by 
Zhang and Yu 1 ^ for the longitudinal and transverse in- 
teraction term ify, H±, respectively, it is straightforward 
to obtain a mean-field Hamiltonian 



H 



MF 
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MF 



J, 
~2 



H 



MF 



H 



MF 



H 



MF 



ka 

( C kAo d kAv 
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''J oAkBa + h.C.), 



E =N s {2J l[ m d m c + J 1 _V 2 ), (7) 

where we have defined several mean-field parameters as 
(4 M diA-t ~ 4ai^ai) = 2m d , (d\ Bt diBt ~ 4Bi d iBi) = 



-2m d , (cl At CiAt - cl M CiAi) 



-2m r 



c iBl°iBi) = 2m c and -V = (cj^ + 4i°u) = (4^1 + 
d/^Cif). It can be seen that m<j, m c correspond to magne- 
tization of local spins and conduction electrons, respec- 
tively, while non- vanishing V denotes the onset of Kondo 
screening effect. Besides, since we are considering a half- 
filled lattice, the local constraint of the pseudofermion 
has been safely neglected at the present mean-field level 
with chemical potential setting to zeroi 1 ^ 

Firstly, we proceed to discuss two simple but physi- 
cally interesting limits for Kondo coupling Jn and Jj_, 
which correspond to the antiferromagnetic SDW state 
(J|| S> J±) and Kondo insulating state (J|| -C Jj_), 
respectively^ 

A. The antiferromagnetic spin-density-wave state 

For the case with Jn 3> J±, in general, one expects 
that the antiferromagnetic SDW state to be the stable 
ground-state of Kondo lattice model on the honeycomb 
lattice due to its bipartite feature.— To study the pos- 
sible antiferromagnetic ordered state, diagonalizing the 
mean-field Hamiltonian Eq. [7] with assuming no Kondo 



screening existing (V = 0), we can easily derive ground- 
state energy of the antiferromagnetic SDW state per site 
as 



E 



AFM _ 



J»m c (2m d - 1) 



1 \ - aJ\\m d 



•7(A0) 2 +W)| 2 



and two self-consistent equations from minimizing E^ M 
with respect to magnetization m d and m c , respectively. 

J\\m c (2m d — 1) = 0, 

1 ^ J\\m d /2 + aj(k) 

m r = > 

L am. 



ho 



crj«m d 



7 (fc)) 2 +t 2 |/W| 2 



For further analytical treatment, we may use a sim- 
plified linear density of state (DOS) p(e) = |e|/A 2 when 
transforming the summation over momentum k into inte- 
gral on energy e with A ~ 2.33i being high-energy cutoff. 
Thus, t\f(k)\ can be replaced by |e| to simplify corre- 
sponding calculations and j(k) is replaced by ±3V3Y 
near two nonequivalent Dirac points ±K = ±(0, ^j)- 

From these two equations, one obtains m d = 1/2 and 



1 



\ " 



2A 2 ^ 



(aSVst' + J\\/A)[^]k 2 + (J\\a3V3f + Jy/4) 2 



-^/(J||<r3V3f + Jy/4) 2 ] 

while the ground-state energy per site for the antiferro- 
magnetic SDW state reads 



E 



AFM 



: -^E[( a2 + ( j ii (j3 ^ < ' + j ii/ 4 ) 

cr 

-((J|,a3V3V + J,,/4) 2 ) 3 / 2 ]. 



2\3/2 



(8) 



Apparently, the local spins are fully polarized (m d = 
1/2) while the conduction electrons have small mag- 
netization as shown in Fig. [1] It is also noted that 
when t' = (no next-nearest-neighbor hopping), the 
above m c correctly recovers the value in our previ- 
ous worki^i Meanwhile, the low-lying quasiparticle ex- 
citations in the antiferromagnetic SDW state has the 

energy E±l(k) = ±^J(Mk/2) 2 + (crJy/4 ± SVSt') 2 and 

E±^.(k) = ±J|im c /2. It should be noted that the gap 
around the Dirac points only closes when the condition 
J||/4 = 3y/3t' is fully satisfied, otherwise, any low- lying 
quasiparticle excitations in the antiferromagnetic SDW 
state are clearly gapped. Thus, we may conclude that the 
antiferromagnetic SDW state we obtained is mainly an 
insulating state (except for the case with Jn/4 = 3y3Y) 
with fully polarized local spins (m d = 1/2) while conduc- 
tion electrons only partially polarize (m c < 1/2). This 
feature is similar to the previous study on square lattice, 
thus confirms the validity of our current treatment.— 

Additionally, as a matter of fact, with the help of a 
low energy effective theory similar to the one in SeclHl 
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FIG. 1. Magnetization of conduction electrons (m c ) versus 
next-nearest-neighbor hopping t' and the Kondo coupling Jm 
in the antiferromagnetic SDW state with A ~ 2.33t being 
high-energy cutoff. 



J,/A 




t'/A 



0.05 0.10 0.15 0.20 

FIG. 2. The phase diagram of the topological quantum phase 
transition (TQPT) in the antiferromagnetic SDW states. 
N-SDW denotes the normal antiferromagnetic SDW state 
while the T-SDW represents the topological antiferromagnetic 
SDW state with quantum anomalous Hall effect. The bound- 
ary of these two kinds of states is determined by 3y/3t' = Jm /4 
with A ~ 2.33t being high-energy cutoff. 



the mentioned case for vanished gap (J\\/4 = 3\/3t') can 
be identified as a topological quantum phase transition 
between a N-SDW state and a T-SDW one, which shows 
a quantum anomalous Hall effect in spite of the antiferro- 
magnetic long-ranged order. More details will be pursued 
in the next subsection. 



B. Topological quantum phase transition and the 
T-SDW state 

After obtained the condition for the vanished gap in 
the last subsection, it is interesting to see what new 
physics this will lead to and whether a novel SDW state 
may be uncovered. 

Performing the same treatment as for the Haldane 
model in Sec|TT] on the mean-field Hamiltonian Eq.[7], 
we obtains the following effective action for the antifer- 
romagnetic SDW state 

S = / (fxdr ^[Vw(7m(^* - ieA v) +«w)Vw], (9) 

where the effective mass is defined as m\-\ — rn2\ = m — 
J||/4 and my = = m + Jn/4 with m = — 3v3i'- 
Then, it is straightforward to derive an effective Chern- 
Simon action by integrating out the Dirac fermions 

S CS = J d 2 xdr[We 2 ^e^ x A^A x } 

and we have also defined W — J2 a <r \m°"\ • ^ ^ s eas y 
to see that a quantized Hall conductance with the value 
ct h = 2e 2 /h (W = -4) is obtained if 3V3t' > J\\/4 (See 
the second subsection of Sec|TT]for the calculation of the 
quantized Hall conductance.). In contrast, when 3V3t' is 
smaller than Jy/4, no such quantized Hall conductance 



can be found (W = 0) and the corresponding effective 
Chern-Simon term vanishes. 

Therefore, it seems that even in the antiferromagnetic 
SDW state, there exists a quantized Hall conductance 
without external magnetic fields, if the quasiparticle gap 
is still dominated by the next-nearest neighbor hopping 
(3-\/3Y) rather than the antiferromagnetic order (Jn/4). 
Thus, we have uncovered a topological antiferromagnetic 
SDW state, namely, the T-SDW state with a quantum 
anomalous Hall effect for 3-\/3V > Jy/4 (Recalling that 
the quantum anomalous Hall effect is defined as a band 
insulator with quantized Hall conductance but without 
orbital/external magnetic field.). 

It is also interesting to see that in the T-SDW state, 
one may use the following effective Chern-Simon action 
to reproduce the quantized Hall conductance 

S= f d 2 xdT[K IJ ^e^ x a I ^aj X + ^q I e^ x A^a IX }, 

J 47T Z7T 

where we have defined the so-called K matrix as Kjj = 
Si, j for I, J = 1,2 and the corresponding charge vec- 
tor reads q = (1,1) T . Physically, the effective gauge 
field ai M and a^p. are introduced to give rise to the con- 
served current for spin-up and spin-down electrons, re- 
spectively. (So the system has U(l) x U((l) symmetry 
for two kinds of spins and a global U(l) symmetry for the 
conservation of total electron number (charge) as well.) 
For the physical observable, the filling factor v, which dc- 
tcrmines the quantized Hall conductance as uh = v \t 
can be calculated by v — q T K~ 1 q = 2, thus the effec- 
tive action correctly reproduces the quantized Hall con- 
ductance obtained in the previous paragraph. Moreover, 
since Det[K] = 1, no states with topological order and 
fractional excitations are involved^ (Generally, fraction- 
alized excitations require a K- matrix with |Det[i^]| > 1 
since the ground-state degeneracy on a torus is equal to 
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Det[K]. 4S ). In fact, the elementary quasiparticle (the 
electron) can also be obtained in the present formulism by 
checking the so-call exchange statistical angle 8. With- 
out any surprise, we find such angle is it which means ex- 
change two identical quasiparticle give rise to a it phase 
in their wavefunction. Therefore, the elementary quasi- 
particle is the usual electron as expected. 

To deepen the discussion, one may utilize the bulk-edge 
correspondence for the above effective abelian Chern- 
Simon theory to derive two decoupled gapless chiral edge 
states as follows 

Sedge = / ' dxdr — [-id T 4>id x 4>i + cid x 4>id x <f>i] 
1=1,2 7r 

with a denoting the non-universal velocity of edge states 
and <j)j being the bosonic representation for the two 
edge-state modes (1 = 1 for the spin-up mode while 
1 = 2 for the spin-down mode). Because each edge-state 
mode contributes e 2 /h to the Hall conductance, the to- 
tal quantized Hall conductance is obviously 2e 2 /h as ex- 
pected. It is noted that the above quantized value for 
Hall conductance is protected by the chiral feature of the 
edge-state even when the conservation of electron num- 
ber with different spins is broken (Such breaking could 
happen when fluctuations beyond the present mean-ficld- 
like treatment is considered and the stability of the gap- 
less chiral edge-stat is discussed in Appendix B.). In 
contrast, if one breaks the U(l) symmetry for conser- 
vation of total electron number (e.g. by some super- 
conducting paring terms), the T-SDW state cannot be 
stable anymore since its quantized Hall conductance (or 
the gapless chiral edge-state) will be destroyed generi- 
cally. (Our case is similar to the bosonic example pro- 
vided by Senthil and Levin very recently^ where the 
conservation of total boson number protects the quan- 
tized (charge) Hall conductance.) However, the T-SDW 
state may not be considered as a kind of the symmetry- 
protected-topological state s 42 ' 43 since breaking the con- 
servation of total electron number only leads to some 
superconducting states but not the expected usual anti- 
ferromagnetic SDW states. 

However, one finds that there is only a usual antifer- 
romagnetic SDW state, namely, the N-SDW when the 
gap is dominated by the antiferromagnetic order (J||/4 > 
3\/3t'). Obviously, these two SDW states have the same 
physical symmetry and at the same time break the spin- 
rotation invariance, however, they are rather different 
states of matter due to the response to the electromag- 
netic field (The former has quantized Hall conductance 
while the latter docs not.). Therefore, this provides a 
simple example beyond the Landau-Ginzburg paradigm, 
particularly the symmetry-breaking based classification 
of states of matter i24 We note that although the T-SDW 
state and the N-SDW states cannot be fully identified 
by symmetry-breaking paradigm, one may use the their 
distinct quantized Hall conductance (or their low energy 
effective Chcrn-Simon action and the robust chiral edge 
states) to identify and classify them completely. 



Moreover, when the gap closes, a topological quan- 
tum phase transition similar to the one in Ref. [38[ ap- 
pears between these two distinct antiferromagnetic SDW 
states and gapless Dirac fermions reappear near the Dirac 
points. However, in contrast to the case in Ref. [38|, no 
discontinuity of the third derivative of the ground-state 
energy is found near the topological quantum phase tran- 
sition. This is due to the fact that in our case the effec- 
tive magnetic field, which the conduction electron expe- 
riences, is fixed (irid = 1/2) throughout the whole an- 
tiferromagnetic region while the effective magnetic field 
varies in Ref. (38j . More importantly, when considering 
fluctuation effect, in Sec. |V] we will find that the men- 
tioned topological quantum phase transition should fall 
into the 3D-XY universal class though the critical the- 
ory is fermionic. We note that such new feature is not 
reported in Ref. [Hj]. The main findings in this subsec- 
tion are systematically summarized in Fig. [3] 



C. The Kondo insulating state 

Another interesting case appears when Jii <C J±. It 
is natural to expect that a Kondo insulating state arises 
in this situation for half- filling! 14 ' 16 Following the same 
methology of treating antiferromagnetic SDW state, we 
can get the ground-state energy per site for the expected 
Kondo insulating state with V ^ but no magnetic or- 
ders nid = m c = 

E Kondo^ J± y2 _ _±T (A 2 + (3^)2 + j2 ^2x3/2 

y 3A 2 

-((3V3t') 2 + JlV 2 f /2 ]. (10) 

Minimizing E^ ondo with respect to Kondo hybridiza- 
tion parameter V, we obtain V 2 = ygj^A 4 — 8A 2 JJ — 

16 J\(?>\/3t') 2 + 16J 4 ] which implies a critical coupling 

Jl = j^[\J N 2 + (3 v / 3i') 2 -3V3t'] corresponding to van- 
ishing V. It is noted that V cx (Jj_ — J±) in contrast 
to usual mean-field result j3 = 1/2, and this can be 
attributed to the low-energy linear DOS of conduction 
electrons on the honeycomb lattice at half-filling. Sim- 
ilar critical behavior for onset of Kondo screening on 
the honeycomb lattice has been obtained in the study 
of Kondo breakdown mechanism as well^ 3 - As a mat- 
ter of fact, the existence of the critical coupling Jj_ re- 
sults from the competition between the Kondo insulating 
state and the nontrivial decoupled state (This decoupled 
state is in fact the quantum anomalous Hall state de- 
scribed by the spinful Haldane model in Eq.[2|.) where 
V = rrid = m c = 0, its ground-state energy E® = 
-g^r [(A 2 + (3V3t') 2 ) 3/2 - (3V3V) 3 ] comes solely from 
free conduction electrons. Comparing E® and E^ ondo , 
one clearly recovers the critical coupling J£, which justi- 
fies the above simple picture. 

However, since the Kondo insulating state is unsta- 
ble to the decoupled state when J± < J£, one may 
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FIG. 3. The ground-state phase diagram of the topological 
Kondo lattice model. KI is the Kondo insulator and the quan- 
tum phase transition between the KI and the antiferromag- 
netic SDW states is first order. In the antiferromagnetic SDW 
region, N-SDW denotes the normal antiferromagnetic SDW 
state while the T-SDW represents the topological antiferro- 
magnetic SDW state with quantum anomalous Hall effect. 
The boundary of these two kinds of SDW states is determined 
by 3V3t' = Jn/4 with A ~ 2.33t being high-energy cutoff. 



wonder whether a nontrivial decoupled state appears be- 
tween the Kondo insulating state and the antiferromag- 
netic SDW states. It is easy to see that the ground-state 
energy of the antiferromagnetic SDW state E^ FM is al- 
ways lower than E® for any positive coupling Jy and the 
next-nearest-neighbor hopping if. Therefore, a nontrivial 
quantum anomalous Hall state in intermediate coupling 
seems unfavorable based on our current mean-field treat- 
ment. However, one notes that the T-SDW state found in 
the previous subsection in the antiferromagnetic ordered 
region shows the quantum anomalous Hall effect. 



IV. THE GLOBAL PHASE DIAGRAM OF 
TOPOLOGICAL KONDO LATTICE 

Having found the antiferromagnetic SDW states (both 
the N- and T-SDW states) and the kondo insulator in the 
previous section by mean-field decoupling, here we pro- 
ceed to discuss the possible ground-state phase diagram. 

Since a nontrivial decoupling state (the quantum amo- 
malous Hall state) is excluded in the last subsection, in- 
stead, we may consider possible second-order quantum 
phase transition between Kondo insulating state and the 
antiferromagnetic SDW states. The boundary of the 
transitions can be determined by comparing the ground- 
state energies of Ef FM (Eq.0) and Eff ondo (Eq.rjJJ). 
For physically interesting case with J± = J|| = J, the 
phase diagram is shown in Fig. [3j from which we can see 
that there exist three distinct states, one is the Kondo 
insulator (KI) and the other two are the N-SDW state 
and the T-SDW state with quantum anomalous Hall ef- 
fect, which is stable for large next- nearest- neighbor hop- 
ping t' . The phase transition between the two kinds of 
SDW states is the topological quantum phase transition 



which has been studied in previous section. However, in 
contrast to one's expectation, one can check that these 
putative continuous second-order quantum phase transi- 
tion between the Kondo insulating state and the antifer- 
romagnetic SDW states are in fact first-order when com- 
paring the first-order derivative of E^ ond ° and E^ FM 
with respect to the Kondo coupling J for different fixed 
if . Thus, we do not expect radical critical behaviors near 
such first-order quantum phase transition points in the 
spirit of Landau- Ginzburg paradigm^ 

Additionally, it is noted that the mentioned first-order 
quantum phase transition has also been obtained on the 
square lattice^ (with t' = 0) and we suspect this feature 
may be generic for conventional mean-field treatment 
of Kondo lattice models according to standard Landau- 
Ginzburg phase transition theoryJ^ However, we point 
out that it is a subtle issue to compare the results of 
a first-order quantum transition with numerical simu- 
lations, particularly when the first-order transition is a 
weak one^ Moreover, generically, a possible coexistence 
region of the Kondo insulating state and the antiferro- 
magnetic ordered state cannot be excluded but we will 
leave this interesting issue for future workJ^ 



V. EXTENSION AND DISCUSSIONS 

A. Spin fluctuation effect in antiferromagnetic 
spin-density wave states 

Here, we discuss the spin fluctuation effect in the anti- 
ferromagnetic spin-density wave states, which is omitted 
in the previous mean-field treatment in Sec. IIIII 

First, let us recall the effective Dirac action (Eq. [5]) 

S = / d 2 xdr ^[Vw(7m(^m ~ ieA^) + m aa )ip acr ], 

where we have defined the effective mass asmi| = = 
m— J\\/i and mu = rri2\ = m + Jy/4 with m = —3\/3t'. 

Following Ref. [38|, when the antiferromagnetic order is 
well established, the effect of spin fluctuations is equiv- 
alent to introduce an effective U{1) dynamic gauge- field 
& M into the above action. 



S' = J d 2 xdr [?/w fa {dp - ieAp - ieab^) 



It is noted that different spin flavor of electrons have the 
opposite gauge charge of b^, which just indicates that the 
gauge-field 6 M describes the spin fluctuations of ordered 
magnetic background. 

After integrating out Dirac fermions, one can obtain 



S'r 



CS ^ I " 87r|m 0(7 



For normal antiferromagnetic spin-density wave(N- 
SDW) states, we have m\\ — < and mij, = 
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m,2-\ > 0, thus the resulting action vanishes. In contrast, 
when we consider the topological antifcrromagnctic spin- 
density wave(T-SDW) states, the effective action reads 

/— 2ie 2 
d 2 xdT[^—e^ x {A^d lJ A x + b^d lJ b x )].(ll) 

As argued in Ref. HH, the Chern- Simon term of 6 M gives 
rise to two gapless chiral modes, which only carry spin 
degrees of freedom of physical electrons. However, since 
these two modes do not carry charge degrees of freedom, 
they are not protected by the conservation of particle 
number. Therefore, we suspect two chiral modes from 
the spin fluctuation (b^) will be gapped and no noticeable 
spin current could exist in T-SDW states. 

B. Spin fluctuation effect at the topological 
quantum phase transition point and relation to 3D 
XY universal class 

In this subsection, we devote to discuss the Spin fluc- 
tuation effect at the topological quantum phase tran- 
sition point between N-SDW and T-SDW states(m = 
-3y/3t' = -Jj|/4) in Sec. HIl Here, the effective mass 
of Dirac action is mi-f — = — Jm/2 < and 

rni^ = 7?i2^ = 0. Thus, V'lft^j. a re massive and can 
be safely integrated out while one should not integrate 
out , 0i^)'02t due to gaplessness of them. Then, following 
the treatment of last subsection, one obtains 

S" = S cs + S\i + S^f, 

S cs = J d 2 xdT{^-e^ x (A^A x + b^b x )}. 
Sii = J d 2 xdr[^ U 7 AI (9 M - ieA^ + ieb^ n ], 

S21 = J d 2 xdT[ip2-t7iJ.(d l i - ieA v - ieb^)^}, (12) 

where we have integrated out two massive modes, which 
leads to a Chcrn-Simon term for A^ and 6 M , respectively. 
To our surprise, one may note that the above action re- 
sembles to the one in Ref. H^, where such action describes 
the phase transition between the bosonic integer quan- 
tum Hall phases^, and superfluid phase. (Please note 
that in our case, we have two flavor fermions with op- 
posi te g auge charge while there exists only one flavor in 

Ref. |49|.) In Ref. |49|, those bosonic integer quantum Hall 

2 

phases have quantized Hall conductance an — 2n4- with 
n = 0, 1, 2, 3, .... (The one with n = just corresponds 
to the trivial Bose-Mott insulator.) Obviously, one ex- 
pects there will be a usual 3D-XY transition between 
the bosonic integer quantum Hall phases and the super- 
fluid phase since we have a natural local order parameter 
if approaching the critical point from the well-defined su- 
perfluid phase. Interestingly, it is known that the above 
fermionic action in fact provides an alternative descrip- 
tion for the usual 3D-XY transition , i 56 thus the cor- 
rectness of the fermionic effective action is justified and 
does not violate our basic physical intuition. 



For our case, the T-SDW state has quantized Hall con- 

2 

ductance an = 2%- while the N-SDW state has van- 
ished quantized Hall conductance. In some sense, one 
may identify N-SDW and T-SDW states as the super- 
fluid phase and the bosonic integer quantum Hall phases 
in Ref. EH, respectively, according to distinct features 
on the quantized Hall conductance. Therefore, we may 
conclude that the critical behaviors of topological quan- 
tum phase transition between N-SDW and T-SDW states 
could fall into the 3D-XY universal class though we can- 
not find a unambiguous bosonic local order parameter for 
our case. In our view, the similarity between our case and 
the bosonic integer quantum Hall transition is indeed an 
interesting new finding and it is desirable to see more ex- 
amples where some ferminic theories can dual to certain 
kinds of bosonic ones. 



C. Kane-Mele-Kondo lattice model 

A careful reader may wonder whether there exists a 
similar T-SDW state in the Kane-Mele-Kondo lattice 
model studied in Ref.(3(|. We have studied this ques- 
tion by using the same treatment in the present paper. 
It is found that the edge states resemble the case in usual 
2+ ID topological insulator, where the gapless helical 
edge state exists and the spin Hall conductance is quan- 
tized due to the gapless edge state. However, in our case 
the antiferromagnetic order breaks the time-reversal sym- 
metry, thus the gapless helical edge state will be gapped 
since it cannot be stable due to impurities and weak in- 
teraction without the protection from the time-reversal 
symmetryj 29 i 30 Physically, the quantized spin Hall con- 
ductance contributed by such gapless edge state will also 
be destroyed generically and we conclude that no such T- 
SDW-like states could appear in the Kane-Mele-Kondo 
lattice model. 



D. Bernevig-Hughes-Zhang model with Hubbard-f/ 

term 

Recently, it is noted that in Ref. [13] , Bernevig-Hughes- 
Zhang model with an extra Hubbard interaction has 
been studied by applying the dynamical mean field the- 
ory. Those authors find that the Hartree-Fock mean- 
field theory cannot capture a topological antiferromag- 
netic phase, which is verified to exist by their dynami- 
cal mean-field theory (DMFT) calculation. In contrast 
to the case of the just mentioned extended Bernevig- 
Hughes-Zhang model, in the present paper, the T-SDW 
state is well-captured by our mean-field decoupling and 
is further inspected by effective Chern-Simon action and 
chiral edge-state in Sec. IIII1 We suspect that such differ- 
ence may result from the different models one used. It 
seems that the mean-field decoupling works more effec- 
tively in the Kondo lattice-like model than in extended 
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Bernevig-Hughes-Zhang model and it will be interesting 
to clarify this point in future work. 



VI. CONCLUSION 

In summary, we have obtained the global ground-state 
phase diagram of the topological Kondo lattice model 
on the honeycomb lattice at half-filling by using an ex- 
tended mean-field decoupling. It is found that besides 
the well-defined Kondo insulator and the normal anti- 
ferromagnetic SDW state, there can exist a novel topo- 
logical SDW state with quantum anomalous Hall effect. 
The topological SDW state cannot be distinguished with 
the normal antiferromagnetic SDW state in terms of the 
Landau-Ginzburg paradigm, specifically, the symmetry- 
breaking based classification of states. However, such a 
novel SDW state can be indeed fully encoded by its low 
energy effective Chern-Simon action with gapless chiral 
edge-state. 

Moreover, the phase transition between the two kinds 
of SDW states is a topological quantum phase transition 
while a first-order quantum phase transition is found be- 
tween the Kondo insulating state and the antiferromag- 
netic SDW states. Interestingly, the mentioned topolog- 
ical quantum phase transition can be described by Dirac 
fermions coupled Chern-Simon gauge-field, which indi- 
cates such topological quantum phase transition may fall 
into the 3D-XY universal class. It is expected both the 
global ground-state phase diagram and the novel topo- 
logical SDW state could be realized by experiments of 
ultra-cold atoms on the honeycomb optical lattice . 57 ! 58 
We hope the present work may be helpful for further 
studies on the interplay between conduction electrons 
and the densely localized spins for the honeycomb lat- 
tice. 
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Appendix A: Derivation of Chern-Simon action 

Here, we would like to give a brief derivation of the 
effective Chern-Simon action Eq. [6] from the Dirac action 
Eq.[5]. First, the Dirac action is written as 

S = / d 2 xdr V|#«r(7/i( S M " ieA v) + m)Vw]-(Al) 



Then, integrating out Dirac fermions one obtains 

S eff = AH n Dei [7^ - ieA^) + m] 
= NTrH^(9 fl -ieA fl )+m] 

= NTrM^i* + m \ + M 1 ~ *e(7iA + ™) _1 7/*Au 
d 3 q 



N 



(27T) 



1 A y p. llv {q)A v 



(A2) 



where il^q) - —J T2^ lr i mi+ki lv m 'i +{k+q) i ln\ 
=f I m ^ + ( 1 fc+g)^ [-^gArr(7 M 7 i , 7A )] + ... ~ 

87r | ™i £ gA * s ca l cmate d at one-loop level. We 
have also used the identity Tr(-f a j v j\) = 2i& vX 
with 70 = T z , 71 = t x and 72 = r y while 

o arcsinf — , 9 ) 

f d 3 k r 1 1 1 _ Vg+ggg ' ^ 1 

J (2tt) 3 \-m' 2 + k 2 m 2 + (k+qY 2 J 47r|g| — 87r|m| 

for \q\ -c \m\. Therefore, the effective Chern-Simon 
action Eq.[6] is obtained as 



&eff— I 77, — — Z — i ^~^ V ^(l\A v 

J (27r) ci 87r|ra| 
d2xdT[£2 ^\ 



e^ x A^d v A x }. (A3) 



Appendix B: Stability of the gapless chiral 
Edge-state 

In Sec lIIH the decoupled gapless chiral edge states are 
described as follows 

Sedge = £ / dxdr-^- [—id T (f>id x <f>i + cid x <f>id x (f>i] . 

1=1,2-' 7F 

To discuss its stability to weak impurities or interaction 
effect, it is helpful to write down the corresponding fer- 
monic formalism 5 ^ 

Hedge = £ / dx[4(-i Cl d x )^l]- (Bl) 
7=1,2 J 

If the total particle number is conserved, in general, 
the interacting term will be the following form 5 ^ 

Hint = H\+ 2?2 + H3 

Hi = g 1 J dx[iplipiiplipi + ipl^ipti^] 

H 2 = 92 I dx [ip\ ipnpl ip 2 ] 



H 3 = 53 / dx\^\^2 + ^ 2 ip\Mi]. (B2) 

Obviously, the dangerous H 3 vanishes due to ipiipi = 
yiyi = 0- Hi, H2 do not vanish but they cannot gap out 
the edge states since they only correspond to the usual 
forward scattering. 

Besides these interacting terms, the mass term H m = 
M J dx[ip\tp2 + V4V'i]> which can result from weak impu- 
rity scattering, may be important when considering the 



t„/,t„ 
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stability of the gapless chiral edge-stated However, due 
to the chiral feature of the edge-state, such mass term 
does not lead to a gap but a shift of energy (the quasi- 
particle energy spectrum is E/~± = ±M + ck), which can 



be easily compensated by adjusting the chemical poten- 
tial. Therefore, we may conclude that the gapless chiral 
edge-state is at least stable under weak impurities or in- 
teraction effect as one expects. 
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